Narrowing of the Cone-of-Direct Gaze Through Reinforcement Learning

نویسندگان

  • Sam Blakeman
  • Denis Mareschal
چکیده

The Cone of Direct Gaze (CoD) is described as the range of eye gaze deviations over which an observer reports gaze as being directed towards them. The CoD has been found to narrow with age across childhood (Mareschal et al. 2016). We investigated whether reinforcement learning, so critical in shaping eye gaze responses in infancy, was able to account for the emergence of a CoD and its narrowing in childhood. To this end, we adapted Triesch et al.'s (2006) reinforcement learning model by (1) defining a topology over object locations, and (2) introducing opponent non-linear reward profiles for looking at objects and caregivers. In Simulation 1 we show that these modifications give rise to a functional CoD in which there is reduced eye gaze following and increased fixation on the caregiver for locations with a small caregiver eye gaze eccentricity. In Simulation 2 we show that the width of this effect reduces with learning, suggesting that developmental decreases in the CoD may be driven by reinforcement learning. In Simulation 3 we explore how changes in model parameters can explain the CoD in high anxiety populations. Finally, the model provides one way of unifying the developmental gaze-following and CoD literatures, until now considered largely independent.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Dynamic Obstacle Avoidance by Distributed Algorithm based on Reinforcement Learning (RESEARCH NOTE)

In this paper we focus on the application of reinforcement learning to obstacle avoidance in dynamic Environments in wireless sensor networks. A distributed algorithm based on reinforcement learning is developed for sensor networks to guide mobile robot through the dynamic obstacles. The sensor network models the danger of the area under coverage as obstacles, and has the property of adoption o...

متن کامل

Emergence of Mirror Neurons in a Model of Gaze Following

Gaze following is the ability to re-direct one’s gaze to the location where another agent is looking. We present a computational model of how human infants or other agents may acquire gaze following by learning to predict the locations of interesting sights from the looking behavior of other agents through reinforcement learning. The model accounts for many findings about the development of gaz...

متن کامل

Transparency and Socially Guided Machine Learning

In this paper we advocate a paradigm of socially guided machine learning, designing agents that take better advantage of the situated aspects of learning. We augmented a standard Reinforcement Learning agent with the social mechanisms of attention direction and gaze. Experiments with an interactive computer game, deployed over the World Wide Web to over 75 players, show the positive impact of t...

متن کامل

The development of fine-grained sensitivity to eye contact after 6 years of age.

Adults use eye contact as a cue to the mental and emotional states of others. Here, we examined developmental changes in the ability to discriminate between eye contact and averted gaze. Children (6-, 8-, 10-, and 14-year-olds) and adults (n=18/age) viewed photographs of a model fixating the center of a camera lens and a series of positions to the left/right or upward/downward and judged whethe...

متن کامل

Development of Reinforcement Learning Algorithm to Study the Capacity Withholding in Electricity Energy Markets

This paper addresses the possibility of capacity withholding by energy producers, who seek to increase the market price and their own profits. The energy market is simulated as an iterative game, where each state game corresponds to an hourly energy auction with uniform pricing mechanism. The producers are modeled as agents that interact with their environment through reinforcement learning (RL...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017